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STEP  INTO  COMPUTATIONAL  GEGMETRY 
NOTEBOOK  III 


Abstract 

In  this  notebook  we  present  a  collection  of  three  new  results  in  planar 
computational  geometry.  The  first  problem  is  to  test  a  given  n-vertex  sim¬ 
ple  polygon  for  monotonicity;  this  problem  can  be  optimally  solved  in  time 
3  (n).  The  second  result  is  an  improved  algorithm  for  the  rectangle  enclosure 
problem;  this  algorithm  improves  over  an  existing  one  by  using  optimal  space 
d(n).  Finally,  the  third  result  is  the  construction,  in  time  O(nlogn),  of 
the  shortest  path  between  two  points  in  the  interior  of  an  n-vertex  polygon 
P,  when  the  path  is  constrained  to  lie  within  P. 
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STEPS  INTO  CGMFUTATIGNAL  GEOHETRY 


NOTEBOOK  III 


F.  P.  Preparata,  Editor 


A  long  while  after  Notebook  II  of  this  collection,  which  appeared  in 
September  1977,  this  notebook  contains  a  few  new  results  in  computational 
gecmetry,  whose  manuscript  sizes  do  not  reach  the  usual  staxidard  of  tech¬ 
nical  reports  but  whose  content  may  be  of  interest  to  researchers  in  the 
field.  Again,  one  of  the  main  reasons  of  this  collection  is  ease  of  access. 

The  first  problem  considered  is  the  test  of  tdiether  a  given  n- vertex 
simple  polygon  is  monotone.  Since  certain  computational  problems  involving 
polygons  are  easier  for  monotone  than  for  arbitrary  simple  polygons,  the 
question  has  not  only  theoretical  but  also  practical  interest.  We  present 
an  9 (n)  time  solution  of  the  problem  of  deciding  whether  a  given  simple 
polygon  P  is  monotone  and,  if  so,  of  exhibiting  a  line.!  with  respect  to 
which  P  is  monotone.  As  a  consequence,  a  monotone  polygon  can  be  triangulated 
also  in  time  9 (n) . 

Next  we  have  studied  a  problem  which  has  received  some  attention 

recently  in  Che  context  of  the  geometry  of  rectangles:  Che  rectangle 

enclosure  problem.  Given  a  set  of  n  rectangles  in  Che  plwe,  with  sides 

parallel  to  the  coordinate  axes,  we  must  find  all  q  pairs  of  rectangles 

such  Chat  one  rectangle  of  the  pair  encloses  the  ocher.  The  algorithm 

presented  is  an  alternative  to  and  an  improvement  of  Che  one  by  Vaishnavi 

2 

and  Wood.  While  both  techniques  have  worst-case  running  claw  O(nlog  n  +  q), 

2 

Che  described  algorithm  uses  optimal  storage  9 (n)  rather  chan  O(nlog  n)  as 
Che  Vaishnavl-Wood's  technique,  and  works  entirely  in-place  using  very 
conventional  data  structures. 


The  third  problem  reported  In  this  notebook  is  the  construction  of  tiw 
Euclldeen  shortest  path  within  a  simple  polygon  F.  Given  source  s  and 
destination  t  as  two  points  in  the  Interior  of  F,  Shamos  had  originally  solved 
this  problem  (which  he  called  ''internal  distance")  by  first  constructing 
the  viewabillty  graph  of  its  vertices  and  subsequently  by  applying  a 
standard  shortest  path  algorithm  to  the  viewabillty  graph,  where  each  edge 
is  wei^ted  with  its  length.  In  acttiality  only  relevant  portions  of  the 
viewabillty  graph  need  be  constructed.  Here  we  present  an  algorithm  based 
on  the  observation  that  if  we  triangulate  F,  the  shortest  path  is  topologically 
a  path  on  the  dual  of  the  triangulated  F.  The  described  algorithm  runs  in 
time  O(nlogn)  for  an  n-vertex  F. 


TESTING  A  SIMPIZ  ?(n.YGON  FOR  MGNGTGNICITY 
Franco  P.  Preparata  and  Ksnnath  J.  Supowlt 


1.  Introduction 

Let  P  be  a  simple  polygon  In  the  plane  having  vertices  *  *  * >Pq.i 

counterclockwise  on  Its  bomdary.  The  sides  of  P,  called  arcs,  are  denoted 
as  Cj  -  directed  from  p^  to  p^^j^  (Indices  are  taken 

modulo  a  throughout).  A  chain  is  a  sequence  of 

arcs  on  the  boundary  of  P.  Is  monotone  with  respect  to  a  (straight) 

line  I  if  the  projections  of  the  vertices  Pt»P^^l> • • • »Pj  ^  ordered 
as  the  vertices  in  P  Is  monotone  If  there  exists  a  line  I  such  that 

the  boundary  of  P  can  be  partitioned  into  two  chains  and  ‘=ji  that  are 
monotone  with  respect  to  I  (If  a  direction  Is  chosen  on  I  then  one  chain 
is  monotone  non-decreasing,  the  other  is  monotone  non-increasing) . 

Note  that  the  class  of  monotone  polygons  properly  contain  the  class 
of  convex  polygons,  and  are  properly  contained  in  the  class  of  simple 
polygons.  It  appears  that  certain  computational  problems  involving  polygons 
are  easier  for  monotone  than  for  arbitrary  simple  polygons.  For  example, 
the  fastest  algorithm  known  to  trlangulata  an  arbitrary  simple  polygon 


This  work  was  supported  in  part  by  National  Science  Foundation  Grant 
MCS-78- 13642,  by  tha  Joint  Services  Electronics  Program  Contract  N00014- 
79-G-0424,  and  by  Control  Data  Corporation  Contract  CDCI-G4-AB. 
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requires  9(nIoga)  tlaw  [1].  However,  given  e  line  I  end  a  polygons  P 
iftonotone  with  respect  to  X,  F  can  be  triangulated  in  3 (n)  tine  [I]. 

tfe  consider  the  following  problem:  given  a  simple  polygon  F,  decide 
\diether  F  is  monotone  and,  if  so,  e:diiblt  a  line  I  with  respect  to  which 
F  is  monotone.  We  present  a  d (n)  time  solution  to  this  problem;  hence, 
by  the  above  remarks,  there  is  a  3 (n)  time  algorithm  that,  given  a  simple 
polygon,  triangulates  it  in  9 (n)  time  if  it  is  monotone. 

2.  The  algorithm 

Given  the  polygon  F,  as  defined  in  the  preceding  section,  let  9^  be 
the  counterclockwise  polar  angle  at  arc  e^  (1  ••  0, ...,n-l)  with  respect  to 
a  chosen  direction  (for  example,  the  direction  of  e^).  Define  as  the 
counterclockwise  wedge  from  to  9^  if  the  external  angle  at  vertex  p^ 

is  2  180*;  as  the  clockwise  wedge  from  9 to  3^,  otherwise.  Note  that, 
by  the  simplicity  of  P,  the  angle  of  wedge  (i  *  0,...,n-l)  has  size 
<  180" . 


(a)  (b) 


Figure  1.  Illustration  of  the  correspondence  between  wedge 
and  the  external  angle  at  p^. 
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Glvttn  a  chain  C  -  define  a(C)  -  U  a.,  i.e., 

J  4^*  i»j+l  ^ 

a(C)  is  the  union  of  the  wedges  Obviously,  a(C)  is 

a  wedge.  We  now  prove: 

Le™»*  1  -  C  «  (e^,...,e^)  is  aonotone  with  respect  to  1  if  and  only  if 
the  normal  to  I  has  a  polar  angle  3  $  a(C). 

Proof;  Given  that  C  is  monotone  with  respect  to  i,  suppose  that 
3  €  a(C)  (figure  2b).  This  implies  chat  there  is  at  least  one  wedge 
such  chat  3  €  for  some  i  €  { 1,2, . . .  ,k-l} .  If  we  now  consider  (figure  2a)  the 


Z'' 

/ 

/  V 


/;y 

V/'  ‘ 


'"4  a(C) 


Figure  2.  Illustration  for  the  proof  of  Lemma  1. 

projections  of  vertices  ^  have  that  the  projection's 

of  p^  and  p^^2  ^  anno* 

cone  with  respect  to  Z,  a  contradiction.  Thus  3  %  a(C). 

Conversely,  suppose  chat  C  is  not  monotone  with  respect  Co  2.  Then 
there  is  a  vertex  p^  of  C  for  which  the  preceding  arguments  can  be 
reversed. 


Cmstdcr  now  a  iBoaotona  polygon  P.  Monotonlelcy  wmmaa  Chat  tbara  are 


two  vertices  p^  and  p^  of  P  and  a  line  t,  such  that  chains  and 
are  monotone  with  respect  to  i  (figure  3a).  In  the  polar  diagram  (figure 
3b),  we  construct  the  wedges  or(C^j)  and  er(C^^).  These  two  wedges  are 
possibly  separated  by  two  wedges  Yj  and  y^  (aee  figure  3b).  Note  chat 

6  a(Cj^)  and  8^  €  a(Cj^j);  also  Y^^  £  oi^y  iriience  sire  (y^)  s  size  (a^^)  < 
180*.  Similarly,  size  (Y^)  <  130*.  Moreover,  by  Lasma  1,  the  line  I' 
passing  through  the  origin  of  Che  polar  diagram  and  perpendicular  Co  I 
intersects  neither  a(Cj^j)  nor  a(Cjj^);  thus  and  cif(Cj^)  lie  on  opposite 


i  ’i 


\ 

\ 

(a)  (b)  ' 

Figure  3.  Illustration  of  the  correspondence  between  a 

simple  polygon  P  and  polar  diagram  of  its  arcs. 

The  polar  rays  corresponding  to  the  n  arcs  of  P  partition  the  polar 
range  [0,2rr)  into  n  consecutive  wedges  (some  of  which  could  be  of  size  0). 
Let  '  be  one  '  these  wedes ;  Che  multiplicity  ^  (or)  of  or  is  defined  as 
ia(cr)  '  a  C  cir^}|  ,  i.a.,  the  number  of  wedges  cr^  which  contain  or.  It 
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follows  that  the  previously  introduced  and  are  precisely  wedges 
whose  nuitipliclty  is  I  and  idiich  are  antipodal  (i.e.,  they  are  crossed 
by  the  sane  straight  line).  It  is  not  difficult  to  see  that  the  arguneni..* 
can  be  reversed,  thus  proving  the  following  theorem: 

Theorem.  A  simple  polygon  P  is  monotone  if  and  only  if  the  polar 
diagram  of  its  arcs  contains  at  least  one  pair  of  antipodal  intervals  of 
multiplicity  1. 

This  theorem  imnediately  suggests  an  algorithm  to  test  a  simple 

polygon  P  for  monotonicity;  we  process  the  boundary  of  P  in  the  order 

e^.e, ,...,e  When  we  process  an  edge  e.,  we  insert  or.  Into  the  polar 

u  I  n-i  j  1 

diagram  by  updating  the  multiplicities  of  the  polar  wedges  so  far  con¬ 
structed.  Note  that  the  multiplicity  of  a  wedge  cannot  decrease;  since 
we  are  seeking  polar  wedges  of  multiplicity  1,  it  is  irrelevant  whether  a 
wedge  has  multiplicity  2  or  greater.  Thus  we  shall  label  each  wedge  with 
a  symbol  in  the  set  {0,1,2},  where  {0,1}  are  actual  multiplicities  and  2 
denotes  a  multiplicity  2  2. 

During  processing  we  maintain  a  doubly- linked  circular  list  of  polar 
angles,  each  of  which  separates  two  adjacent  wedges.  Each  of  the  two 
pointers  (forward  and  backward)  is  labeled  in  the  set  {0,1,2}.  In  addition, 
we  have  a  pointer  to  the  current  position  3  in  the  polar  diagram.  We 
claim  that  the  list  satisfies  the  following  properties: 

(1)  the  angles  are  in  increasing  counterclockwise  order; 

(2)  the  wedge  labels  possibly  with  the  exception  of  one  single  0 
label  —  form  an  alternating  string  of  I's  and  2's. 

To  prove  this  claim,  we  outline  the  algorithm. 

Initial  step.  0  is  chosen  conventionally  as  3q.  There  is  a  single 

wedge,  labeled  0.  We  insert  into  the  list  angle  3  and  label  with  1 
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the  wedge  determined  by  cr^,  and  3  is  set  to  9^. 

General  step.  Let  3  be  the  current  position  and  assiixne  that  the  list 
satisfies  properties  (L)  and  (2).  We  process  ^ ^  larger 

than  9  we  scan  the  list  forward,  while  ^  not  larger  than  3 

we  scan  it  backwards.  The  scan  terminates  when  3^  can  be  inserted. 

In  this  process  we  increase  by  1  each  wedge  label  different  from  2 
and  merge  any  two  consecutive  wedges  receiving  identical  labels 
(merging  is,  of  course,  done  by  deleting  the  node  corresponding  to  the 
angle  value  which  separates  them).  With  regard  to  the  updating  of  3, 
suppose  that  3^  is  to  be  inserted  into  wedge  0,3']:  if  the  pointer 
from  3  to  3 '  ia  labeled  0  or  1,  then  a  new  list  node  is  created  and 
5  else  no  new  node  is  created  and  3  «-  3  ’ . 

Clearly  property  (1)  is  satisfied  after  the  general  step,  because 
3^  is  inserted  in  its  appropriate  order.  Property  (2)  is  also  satisfied, 
since  wedge  merging  guarantees  the  alternation  of  1  and  2  labels  on 
continguous  wedges  (with  labels  different  from  0) . 

From  the  performance  viewpoint,  it  is  convenient  to  charge  the  computa¬ 
tional  work  to  each  individual  list  node.  A  list  node  is  initially 
established  in  constant  time.  Subsequently,  during  list  scans,  a  node  is 
traversed  in  one  direction;  its  pointers  are  for  brevity  referred  to  as 
incoming  and  outgoing.  The  labels  of  both  pointers  are  updated  (0  —  1, 

1  2,  2  2)  and  when  both  pointers  are  labeled  2  the  node  is  deleted. 

Sach  node  traversal  uses  constant  time  and  each  node  can  be  traversed  at 
most  twice  before  its  deletion.  It  follows  chat  the  total  running  time 
is  0(n). 

AC  Che  termination  of  the  above  algorithm,  we  have  a  partition  of 
the  polar  range  [0,2tt)  into  0(n)  wedges  with  alternating  labels  1  and  2. 


10 


Scanning  the  sequence  of  angles  by  means  of  two  pointers  and  b^  we 
can  determine  the  pairs  of  antipodal  wedges. Specifically,  let  3  (b^) 
denote  the  angle  pointed  to  by  b^.  We  set  initially  9 (b^)  *  0  and 
advance  9  (b^),  until  9  (b2)  -  9  (bj^)  i  180“;  at  this  point  9  (bj^)  is  advanced 
until  9  (b^)  *  9  (b^)  <  180“,  when  the  advancement  of  9  (b^)  is  restimed;  and 
so  on  until  9  (b^)  *  0.  This  process  clearly  runs  in  time  0(n)  and  obtains 
all  pairs  of  antipodal  wedges  (^ich  are  known  to  be  0(n)  [3]),  ^ose  labels 
are  concurrently  compared.  Since  both  major  tasks  (construction  of  the 
sectors  and  detection  of  antipodal  pairs)  can  be  completed  in  linear  time, 
the  entire  monotonicity  test  runs  in  linear  time,  which  is  optimal. 

Note  that  the  above  algorithm  obtains  all  directions  with  respect  to 
which  F  is  monotone. 

Conclusion 

Testing  an  arbitrairy  polygon  (i.e.,  a  sequence  of  vertices)  for  con¬ 
vexity  [3],  testing  a  simple  polygon  for  star-shapedness  [2},  and  testing 
a  simple  polygon  for  monotonicity  are  all  9 (n)  time  problems.  An  inter¬ 
esting  open  problem  in  this  area  is  testing  an  arbitrary  polygon  for 
simplicity.  For  this  problem,  the  fastest  algorithm  known  is  3(nlogn) 
time  [4],  but  no  super- linear  lower  bound  is  known. 

Acknowledgements 
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The  following  technique  is  a  modification  of  an  algorithm  due  to 
M.  I.  Shamos  [3]  to  obtain  the  diameter  of  a  convex  polygon. 
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An  improved  algorlchm  for  Che  rectangle  enclosure  problem'*’ 

D.  T.  Lee  and  F.  P.  Preparata 
January,  1981 

Abstract.  Given  a  set  of  n  rectangles  in  the  plane,  with  sides  parallel 
to  Che  coordinate  axes,  the  rectangle  enclosure  problem  consists  of  find¬ 
ing  all  q  pairs  of  rectangles  such  Chat  one  rectangle  of  the  pair  encloses 
the  ocher.  In  this  note  we  present  an  algorithm  alternative  to  the  one  by 

Vaishnavi  and  Wood;  while  both  techniques  have  worst-case  running  time 

2  2 
O(nlog  n  -t-  q),  ours  uses  optimal  storage  0(n)  rather  chan  O(nlog  n)  as  the 

Vaishnavi -Wood ' s  technique.  Our  algorithm  works  entirely  in-place  and  uses 

very  conventional  data  structures. 
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AN  IMPROVED  ALGORITHM  FOR 
THE  RECTANGLE  ENCLOSURE  FROBIEM 


1.  Given  a  set  of  n  rectangles  in  the  plane,  with  sides  parallel  to 
the  coordinate  axes  (iso>oriented  rectangles),  the  rectangle  enclosure 
problem  consists  of  finding  all  q  pairs  of  rectangles  such  that  one 
rectangle  of  the  pair  encloses  the  other. 

This  problem  is  an  interesting  one  in  the  "geometry  of  rectangles", 

which  is  relevant  to  several  practical  applications,  primarily  to  the 

computer-aided  design  of  VLSI  circuits  [1,2].  The  best  known  solution  is 

due  to  Vaishnavi  and  Wood  (  3  ]  and  runs  in  time  ©(nlog^n  +  q)  using  space 
2 

O(nlog  n);  their  approach  makes  crucial  use  of  some  versatile,  but  space¬ 
consuming,  data  structures  called  range  trees  and  segment  trees  [4,3]. 

In  this  paper  a  new  approach  is  described  which  achieves  the  same 
time  bound  but  uses  only  linear  space.  Thus  it  is  space-optimal;  as  to 
computation  time,  there  is  still  a  gap  between  upper-  and  lower-bound. 

2.  We  begin  by  transforming  the  rectangle  enclosure  problem  Into  an 
equivalent  one,  which  is  easier  to  describe  and  understand.  Let 

■  {rj^,r2,.. .  ,r^}  be  a  set  of  iso-oriented  rectangles  in  the  plane  (x,y), 

where  r^  -  [x^^\x^^^]  x  [y^^^y^^^],  with  and  y^^^  < 

Rectangle  r.  encloses  rectangle  r.  if  the  following  four  conditions  hold: 

-  J 


(1) 


„(i)  £  „(j) 


(j)  s  ^(i)  y(i) 


S  y(j)  y(j)  2  y(i) 

’  ^2  ”2 


These  conditions  are  trivially  equivalent  to 


,^(j)^-^(i) 

’  *2  ^1  '  ^1  *  ^1  ’  ^2  ^ 


(2) 
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which  express  the  well-known  relsclon  " ^  "  of  domlnence  between  two  four- 
dimensional  points,  that  is,  •< 

Thus,  after  mapping  each  r^  €  ii  into  its  corresponding  four-dimensional 
point,  the  rectangle  enclosure  problem  becomes  the  point  doa>inance  problem 
in  4-space.  Specifically:  "Given  a  set  S  «  p  is  a  point  in 

4  space}  for  each  point  p^  €  S  find  a  set  c  s  such  that  -  [p|p^  S, 

P  Pi' "• 

Our  approach  to  solving  the  point  dominance  problem  is  very  similar 
to  the  one  used  in  [  6  }  to  solve  a  closely  related  problem,  finding  the 
ma■^r^^lla  of  a  Set  of  vectors  (i.e.,  the  subset  M  c  s  defined  as  M  >  [p|p€  S 
and  there  is  no  q€  S  such  that  p  ^q}).  The  technique  is  an  application 
of  the  divide -and -conquer  principle.  Let  u^,u2,u^,u^  be  the  coordinates 
of  our  4-space.  The  elements  of  S  are  reindexed  so  that  (i  <  j)  ^ 

(Ui(p^)  S  Uj^(p^)).  We  then  have; 

Algorithm  Dominance 

Dl.  (Divide)  Partition  S  into  and  where  »  {p^^, . . .  ,p,  ^^2 1  ; 

^2  *  'PTn/Z':  '••••PQ'- 

D2.  (Recur)  Solve  the  point-dominance  problem  on  S^  and  S2,  separately. 
D3.  (Merge)  Find  all  the  pairs  p^-<  p^,  where  p^  €  Sj^  and  p^  €  S2. 

We  shall  now  discuss  the  implementation  of  step  D3.  For  p^  6  S^  and 
pj  €  82*  since  ^  construction,  we  have  Pj  if  and 

only  if  u^(Pj^)  ^  ^  "  2,3,4.  Thus  Step  d3  is  in  effect,  a 

three-dimensional  problem.  Here  again,  we  solve  it  by  a  divide-and- 
conquer  technique.  Specifically,  let  U2  be  the  median  of  {u^  (p,.  )|  p^€  S^; . 


'r-v, 
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Ml. 

M2. 

M3. 


Algorithm  Merge 


(Divide)  Partition  into  Sj^2-  ^2  ^^21*^22^’ 

-  CpIp  €  Sj^.u^Cp)  i  U2},  •  [pjp  €  82,02 (p)  ^  “2^’  *“** 


^12  *  ^l‘^ll’  ®22  "  ^■^21* 


(Recur)  Solve  the  merge  problem  on  the  set  pairs  {^^^,822^}  and 


■-^12 ’^22^* 


(Combine)  Find  all  pairs  ■<  Pj  such  that  p^^  €  and  p^  €  822* 


To  convince  ourselves  o£  the  correctness  of  the  approach,  note  that 
8  has  been  partitioned  into  {^]^]^>^]^2*^21*^22^ *  each  of  these  four 

subset,  the  point -dominance  problem  is  solved  in  D2;  it  remains  to  be 
solved  between  pairs  of  subsets.  Of  the  six  pairs,  i!S2.1’^12^  ^^21*^22^ 

are  also  processed  in  D2;  ^^12*^22^  processed  in  M2; 

{811,822}  are  processed  in  M3,  while  [Si2,S2i}  need  not  be  considered 
because  for  each  €  $12  and  6  82 1  we  have  UiCp^)  s  Ui(Pj)  and 
“2^Pi^  >  U2(Pj).  Notice,  also  that  Step  M3  (Combine)  is  a  two-dimensional 
Merge  problem  (in  u^  and  u^). 

The  key  operation  of  the  entire  task  is  therefore  the  implementation 
of  step  M3,  the  two-dimensional  Merge  (Combine).  Indeed  the  entire  computa¬ 
tion  reduces  to  the  careful  sequencing  of  steps  like  m3;  therefore,  in 
what  follows  we  shall  concentrate  on  devising  an  efficient  implementation 
of  ''Combine".  We  shall  show  that  "Combine"  can  be  done  in  time  linear  in 
the  input  size,  after  an  initial  O(nlogn)  sorting,  which  is  charged  to 
the  entire  point-dominance  problem. 

3.  The  initial  preprocessing  consists  in  preparing  a  suitable  data 
structure  for  the  sec  S.  Specifically,  we  sec  up  a  quadrup Iv- threaded 
list  (QTL),  with  bidirectional  links.  For  each  p  €  8,  we  construct  a  node 
containing  the  information  (Ui(p) ,U2 (p) ,u^ (p) ,u^(p) ) ;  after  sorting  8  on 
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each  coordinate,  we  establish  four  pointers  NEXIl, . . . ,NEXT4,  so  that  NEXTJ 
describe  the  ordering  on  u^.  Bidirectional  links  are  established  by  four 
additional  pointers  PSEDj  (j  -  1,2, 3, 4).  The  setting  up  of  Che  QTL  for  S, 
obviously,  uses  time  O(nlogn). 

The  QTL  lends  itself,  very  naturally, to  the  linear-time  inpleaientation 
of  the  set-splitting  operations  specified  by  steps  D1  and  Ml  of  Che  preceding 
algorithms.  Indeed,  suppose  we  want  co  split  S  into  [S^,S2}  and  that  Che 
elements  of,  say,  S^,  are  marked.  Then,  by  traversing  the  QTL  on  a 
selected  pointer  NEXT!,  Che  list  corresponding  to  this  pointer  is  easily 
"unmerged"  into  two  lists,  corresponding  to  the  two  sets  {8^,62}  of  Che 
partition.  Analogously  given  and  S^,  in  linear  time  we  can  merge  Che 
two  corresponding  lists  using  "natural  merge"  [  7  ].  Note  that  splitting 
and  merging  operations  simply  involve  modification  of  the  pointers  and 
use  no  additional  space  for  scoring  data. 

Let  us  now  consider  the  inplementation  of  Step  M3,  "Combine".  Here 
ve  have  two  secs,  and  S22>  two-dimensional  points.  The  sets  are 
actually  represented  as  a  doubly-threaded  list  (that  is,  threaded  on  the 
two  coordinates  u^  and  u^) ;  BEG31  and  BEG32  denote  pointers  to  the  first 
positions  of  the  two  lists,  for  and  S22>  respectively,  corresponding 
CO  coordinate  u^  (which  is  the  coordinate  to  be  scanned).  We  also  make 
use  of  a  new  list  L,  which  is  destined  Co  contain  the  sorted  sequence  of 
Che  u^-coordinates  of  a  subset  of  (specifically,  the  u^-coordinates  of 
the  points  of  whose  u^-coordinate  is  no  larger  than  the  current  scan 
value).  Temporarily,  we  use  HEXTL  and  BEGL  to  denote  the  forward  and 
initial  pointers  for  L,  although  '■*  as  we  shall  see  below  —  HEXI4  can  be 
used  in  place  of  HEXZL.  Letting  ] S22I  ■  e  we  propose  the  following 
algorithm: 
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1 

2 

3 

4 

5 


7 

3 

9 


10 


end 


Algor itha  CoBblnt 

begin  ♦•BEG31,  ^2 

while  (J2  g  s)  do 

begin  if  (ujtJiJ  *  U3[J2])  then 

begin  ineerc  u^[jj^Jinto  L 

h  *■  h‘*‘^ 

end 

else  begin  i  *■  BEGL 

^rtiile  U»*A)  end  (U4(j2]  >  u,  (i))  do 
begin  print  (j2,2)  ^ 

I  *-  NEXILCi] 
end 

J2  - 


end 


end 


The  £d>ove  algorithm  has  obviously  the  structure  of  a  merge  technique.  In 

step  3  we  tesc  whether  we  should  advance  on  or  on  822*  ^  former 

case  we  must  insert  into  L  (Step  4).  In  Che  latter  case  (Steps  6-9). 

we  scan  Che  list  L  from  its  smallest  element,  thereby  determining  all  the 

points  dominated  by  p.  ;  this  part  of  Che  procedure  is  straightforward 

J2 

and  runs  in  time  proportional  to  the  number  of  pairs  (J2>i)  which  are 

printed.  The  crucial  Cask  of  the  procedtire  is  represented  by  Step  4: 

"insert  Into  L".  Indeed,  at  first  sight,  it  appears  to  globally 

2 

require  time  proportional  to  ,  since  each  Insertion  may  require  a 

full  scan  of  L;  a  more  sophisticated  implementation  of  L  with  an  AVL  tree 
would  cut  the  global  time  down  to  ({ S^^^l  ^  ’  However,  there  is  an 

interesting  way  to  organize  Step  4  so  chat  its  global  time  requirements 
be  0(|S^^|).  This  is  accomplished  by  a  backward  pre-scan  of  the  u^-lisc 
of  S^j^,  which  generates  the  schedule  of  insertion  into  L  of  the  terms  of 
the  u^-list  of  Indeed,  starting  from  the  largest  element  of  the 

u^-list  and  proceeding  towards  the  smallest,  let  U2(J)  be  the  element 
currently  considered  in  the  scan:  we  save  the  current  value  of  ?BED4[j] 

(on  the  u^-list)  and  update  the  u^-list  by  deleting  u^[J}.  It  is  clear 


we  Illustrate  the  initial  configuration  of  the  u^-  and  u^-llst.  The 
initial  configuration  of  the  array  FSED4  is: 


j 

1 

2  3  4  5 

6 

7 

8 

PSED4: 

E 

Tirnr 

0 

BEG 

[]] 

The  evolution  of  this  array  when  executing  the  above  scan  is  shown  com¬ 
pactly  below  (entries  being  updated  are  encircled) 


j 

initial  PRED4 


final 

(insertion  schedule) 


1  23456  7  3 


7 

4 

1 

a 

BEG 

3 

7 

5 

4 

i 

3) 

2 

VEG 

3 

(ii^ 

5 

4 

i 

3 

2 

BEG 

3 

BEG 

5 

4 

1 

3 

2 

BEG 

3 

BEG 

m 

4 

1 

2 

BEG 

3 

BEG 

3 

i 

3 

2 

BEG 

3 

BEG 

_ 

0 

1 

i 

3 

2 

BEG 

3 

BEG 

i 

1 

i 

3 

2 

BEG 

3 

After 

Scanning 


Therefore,  the  final  configuration  of  the  array  PR£D4  completely  specifies 
the  insertion  schedule  into  the  L-llst  (which  becomes  the  u^-list  when 
the  scan  is  complete)  and  line  4  of  COMBINE  can  be  executed  in  constant 
time.  This  shows  that  the  entire  COMBINE  procedure  runs  in  time  linear 
in  |S^^|  -f  I  S22I  mifflber  of  pairs  (point  dominances)  obtained. 

4.  To  analyze  the  performance  of  the  proposed  technique  we  note; 

1)  All  processing  occurs  in  place,  uses  the  QTL  arrays,  and  reduces 
to  transformations  of  the  pointers'  values.  Thus  the  space  used 
is  0(n). 


2)  As  regards  processing  time  each  dominance  pair  (l.e.,  each 

enclosed  pair  of  rectangles)  is  found  exactly  once  and  in  constant 
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tloe  by  Che  <Alle«loop  (7-9)  o£  Combine.  Thus,  if  q  is  the 
number  of  pairs,  0(q)  optimal  tine  is  used  for  this  activity. 

The  remaining  computing  time  depends  exclusively  on  the  size  n 
of  S:  denote  it  by  0(n).  Also  denote  by  M^(r,s)  the  running  time 
of  Algorithm  Merge  on  tvo  sets  with  r  and  s  d-dimensional  points, 
respectively  (d«2,3).  Assiiming,  for  simplicity,  that  n  be  even, 
we  have 

(3)  D(n) -2D(n/2) +M2(n/2,n/2) +  0(n) 

where  0(n)  is  the  time  used  by  the  "divide"  step  Dl.  Analogously, 
we  have  (assume  that  "m  and  that  r  be  even): 

(4)  MjCc.a)  +M2(r/2,s-m)  +M2(r/2,max(m,s-m)) 

+  0(r  +  s) 

where,  again,  0(r4-s)  time  is  needed  to  perform  the  set  split.  An 

upper-bound  to  is  obtained  by  maximizing  the  ri^t-side  of 

(4)  with  respect  to  m.  Since  M2(r',s')  is  0(r'  4>s'),  arguing  as 

in  [  6  ] ,  we  obtain  that  M^(r,s)  >  0((r -r  s)log(r -fs))  and,  con- 

2 

sequently,  that  D(n)  «  0(n(logn)  ). 

Incidantally,  the  3-dimsnsional  dominance  problem  is  implicitly  solved 
by  Che  technique  described  in  this  paper.  In  ocher  words,  given  a  set  of 
n  points  in  3-space,  the  p  dominance  pairs  existing  in  this  sec  can  be 
found  in  time  0(nlogn4’p)  and  space  0(n),  both  of  which  are  optimal 
(see  [6]). 
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SHORTEST  PATHS  WITHIN  A  SIMPLE  POLYG(»I 


F.  P.  Preparata 

This  note  describes  an  efficient  solution  of  the  following  geometric 
problem:  given  a  simple  n-vertex  polygon  P  In  the  Euclidean  plane  and 
two  distinguished  points  s  and  t,  respectively  called  source  and  destination 
In  the  Interior  of  P,  find  the  shortest  path  between  s  and  t  lying  entirely 
within  P. 

This  problem  has  been  previously  considered  by  M.  I.  Shamos  [1],  who 

called  It  "Internal  distance"  and  described  an  algorithm  which  solves  It 
2 

In  time  0(n  ).  Shamos'  method  is  based  on  the  prior  construction  of  the 
so-called  vlewabllltv  graph  of  a  polygon,  namely  the  set  of  edges  which 
Join  pairs  of  vertices  of  the  polygon  and  are  entirely  contained  in  Its 
Interior;  once  the  viewablllty  graph  Is  obtained,  the  shortest  path  within 
the  polygon  Is  the  shortest  path  on  the  viewablllty  graph  when  each  edge 
Is  weighted  with  Its  length.  We  shall  now  show  that  only  relevant  portions 

of  the  viewablllty  graph  need  be  constructed  thereby  reducing  the  computa- 

2  Q') 

tlon  time  from  0(n  )  to  O(nlogn).'  ' 

We  need  some  nomenclature. 

Definition  1.  An  n-vertex  simple  polygon  P  *  (q2^><]2>  * '  *  ^ 

closed  polygonal  chain  such  that  no  two  nonconsecutlve  edges  Intersect.  A 
diagonal  of  P  Is  a  line  segment  J  l  +  l->  which  does  not  cross  any 

edge  of  P.  P  Is  said  to  be  triangulated  If  Its  Interior  has  been  divided 

This  work  was  supported  In  part  by  National  Science  Foundation  under  Grant 
MCS  7  -13642  and  In  part  by  the  Joint  Services  Electronics  Program  under 
Cont-  iCt  DAAG-29-78-C-0016 . 

^^^All  logarithms  are  to  the  base  2. 
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Into  n-2  triangles  by  n>3  diagonals. 

Definition  2.  The  dual  tree  of  a  triangulated  sioq>le  polygon  P  is  a 
graph  (V,E}  such  Chat  each  vertex  of  V  corresponds  Co  a  triangle  of  the 
triangulation  and  each  edge  of  E  connects  tvo  vertices  of  V  if  and  only  if 
the  corresponding  two  triangles  share  a  diagonal  of  F.  The  diagonal  of  F 
and  Che  corresponding  edge  in  T  are  said  to  be  dual. 

Obviously  T  is  a  tree  whose  vertices  have  degree  at  most  3. 


Figure  1.  Illustration  of  polygon,  sleeve,  diagonals,  and  dual  path 

Definition  3.  A  triangulated  polygon  is  called  a  sleeve  if  its  dual 
graph  is  a  polygonal  chain.  Figure  1  illustrates  Che  notions  of  triangulated 
polygons,  diagonals,  sleeves,  and  dual  graphs. 
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Our  method  is  based  on  the  following  observation.  Let  A(s)  and 
A(t)  be  the  two  triangles  in  (the  triangulated)  P  which  contain  s  and  t, 
respectively.  In  T  there  is  a  unique  path  n  between  the  vertices  which  are 
the  duals  of  A(s)  and  A(c).  The  edges  in  tt  are  themselves  duals  of 
diagonals  of  P,  so  that  the  sequence  of  edges  of  r  corresponds  to  a 
sequence  of  diagonals  d^,d2>...,d^  (ordered  from  s  to  t) .  Since  d^ 
divides  P  into  two  parts,  which  respectively  contain  s  and  t,  the 
shortest  path  from  s  to  t  within  P  crosses  each  and  every  d^,...,d^. 

Notice  that  any  other  diagonal  of  P  is  either  wholly  contained  in  the 
shortest  path  or  does  not  share  any  internal  point  with  it,  since  the 
shortest  path  is  entirely  contained  in  the  triangles  which  are  duals 
of  the  vertices  of  rr. 

This  also  indicates  that,  without  loss  of  generality,  we  may  restr  .  c 
ourselves  to  the  plane  polygon?'  which  dualizes  to  tt,  ^.ith  the  further 
condition  that  s  and  t  be  themselves  vertices  of  the  polygon  (that  is,  we 
replace  4(3)  with  the  triangle  having  as  its  vertices  s  and  the  extremes 
of  d^;  similarly  4(t)  is  replaced  by  the  triangle  having  as  its  vertices 
t  and  the  extremes  of  plane  polygon  P'  in  fact  is  a  sleeve  by 

Definition  3.  Hereafter  we  assume  chat  the  given  polygon  ?  is  a  sleeve 
with  n  vertices,  including  s  and  t. 

Let  and  v^^^  be  the  two  extreme  points  of  diagonal  d^ , 

1  <  i  5  n-3,  and  let  D(s,vp^)  be  the  shortest  path  from  s  to  v^-^\ 
j  •  1,2,  within  Che  polygon  P.  It  is  easy  to  show  chat  DCXiV^*^^}  is  a  polygonal 
chain  whose  points  are  vertices  of  P.  Let  ^  D(s,v^^Vw  D(s,V£“^).  In 
the  graph  D,  there  is  a  unique  vertex  v  which  is  common  to  both  D(s,vf^^) 


and  D(s,v^^^)  and  Is  farthest  from  s  on  either  chain;  we  say  chat  the 
two  chains  diverge  at  v  and  obviously  D(v,v^^^)  and  D(v,v^^^)  have  no 
edge  in  connon. 

Assume  at  first  chat  neither  of  the  laccer  subchains  Is  empty;  then 
we  claim  that  D(v,v^'^^)  (j  -  1,2)  is  an  inward -convex  polygonal  chain, 
i.e.,  it  is  convex  with  convexity  facing  coward  the  interior  of  P.  To 
prove  this,  we  first  show  that  tiie  region  delimited  by  D(v,v^^^), 
D(v,v^^^),  and  d^  (briefly  called  a  funnel)  is' entirely  contained  in  P. 
Let  diagonals  crossed  by  D(v,v^^^)  and  D(v,v^^^). 

Clearly  the  triangle  (v,vf^\v^^^)  ■  R  is  contained  la  P;  assuming 
inductively  that  C  p,  we  see  that  is  obtained  by  adjoining  to 
all  or  part  of  a  triangle  contained  in  P,  thus  snowing  that  R^  ^  P. 

Next  if  D(v,v^-^^)  is  not  inward-convex,  then,  by  the  triangle  inequality, 
there  is  a  shorter  path  from  v  to  v^'^^  entirely  contained  P,  thereby 
violating  the  hypothesis  that  D(s,v^'^^)  is  a  shortest  path  from  s  to 
v^-^^  (see  Figure  2).  This  convexity  property  also  proves  that  D(s,v^^^) 
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(2) 

and  D(s,v^  )  may  diverge  at  moat  at  one  vertex  v;  for,  if  they  diverge  at 
some  other  vertex  u^,  then  they  nust  reconverge  at  some  vertex  U2,  and 
the  two  distinct  subchains  from  u^  and  U2  must  both  be  inward-convex,  a 
clear  inconsistency. 

In  general  is  a  (possibly  empty)  chain  branching  at  some  vertex  v, 
called  a  cusp  into  two  inward-convex  chains,  which  delimit  a  (possibly 
degenerate)  funnel.  Notice  that  either  of  these  two  chains  could  be 

empty  (but  not  both,  since  v^^^  ^  v^^^).  If,  say,  D(v,v^^^)  is  empty, 

(2') 

Chen  clearly  D(v,v^  ')  *  d^;  in  this  case  the  funnel  degenerates  to  a 
single  diagonal,  has  no  interior,  and  becomes  a  single  chain. 

The  algorithm  successively  constructs  D2>D2>-‘->^p  finally 
0(3, c).  In  detail  we  have; 

Initial  Step.  Construct  by  connecting  s  to  v^^^  and  v^^^  . 

General  Step.  (Construct  from  D^) .  Let  v  be  the  cusp  of  0^, 

at  which  the  two  subchains  '^a'^a-1’ "'^0  where  v  »  u^ 


.(1) 


(2) 

1  .  V 

b’  i 


u. .  Without  loss  of  generality,  let  v 


■  v^^2  (s®®  Figure  3) 


'1  “b’  'i  O'  - " - 'i 

Starting  from  Uq  scan  the  sequence  Uq,U2,...|U^  and  let  j  be  the  smallest 

integer  for  which  becomes  a  supporting segment  of  the  boundary 

of  R^.  We  distinguish  two  cases 


(1)  j  a.  Delete  all  edges  “2'*2+l  0  <  2  S  j-1  and  add 


(2) 

edge  ujv^^i  . 


(2)  j  ^  a.  Delete  all  edges  “^“2+1  0  <  i  5  j-1  and  add 

edge  becomes  the  cusp  of 


^  A  line  i  is  a  supporting  line  of  a  convex  open  cuirre  C  if  it  has  at  least 
one  point  in  connon  with  C  and  C  lies  all  on  one  side  of  I,  with  its 
convexity  facing  1. 
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a 


Figure  3.  Illustration  of  the  general  step.  In  (a),  belongs  to 

Ug...u^;  in  (b)  Uj  belongs  to  u^...u^  .  is 

shown  cross-hatched. 

Final  Step.  Once  D  ^  has  been  constructed,  one  of  the  two  sides 
■  "  n- j 

of  ?  incident  on  t  is  treated  as  a  diagonal  d  .  and  the  general  step 

n-i 

is  applied  to  this  case,  yielding  D<3,t). 

The  correctness  of  the  algorithm  depends  upon  the  following  fact. 

For  any  point  u  in  the  triangle  defined  by  the  two  diagonals  d^  and 
a  shortest  path  from  s  to  u  passes  through  v.  For,  assume  the  contrary. 

If  both  D(v,v^^^)  and  D(v,v^^^)  are  nonempty,  consider  the  edge  incident 
on  V  on  either  of  these  subchains:  since  P  is  a  sleeve,  one  of  them  is  a 
diagonal  of  P  (although  not  necessarily  an  original  diagonal  of  the 
triangulated  P) ;  if  either  of  these  subchains  is  empty,  then,  as  we  saw 
earlier,  the  other  subchain  consists  of  a  single  diagonal.  In  either  case, 
let  V  v'  be  this  diagonal  and  let  v  v"  be  the  other  edge  (Figure  4) . 
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The  polygonal  chain  i(s,u)  which  dafines  a  shortest  path  from  s  to  u 
crosses  v  v'  at  some  point  p  v.  We  claim  that  the  distance  from 
s  to  p  on  i(s,u)  is  strictly  less  than  that  (called  on  the  polygonal 
chain  obtained  by  concatenating  D(s,v)  and  the  segment  v  p  .  To  prove 
this,  note  that  the  wedge  formed  by  v  v*  and  v  v"  intersects  both 
and  thus,  the  destination  point  u  in  the  triangle  defined  by  d^  and 

d^_^^  is  in  one  of  three  regions  (see  Figure  4);  all  the  three  cases, 
however,  are  treated  analogously.  Assuming,  for  example,  that  f(s,u)  crosses 
V  v”  (case  shown  in  Figure  5)  in  a  point  p^,  we  have,  by  hypothesis,  chat 
i(s,u)  is  a  shortest  path  from  s  to  u 

length (i(p,Pj^))  i>2~  l«ngth(vp)  +  lengch(vpj^) 

where  i(p,p^)  is  the  subchain  of  f(s,u)  from  p  to  p^.  But,  by  the  triangle 
inequality,  lengCh(vpj^)  ^  lengch(vp)  +  lengch(2(p,pj^)),  whence 

^2  ^  length(vp)  +  length(jt(p,Pj^))  -  length(vpj^)  i  0 

i.e.,  Therefore  ^2  length (pv' )  >  length (pv*  ) ,  contradicting 

the  known  fact  chat  the  shortest  path  from  s  to  v'  passes  through  v. 


Figure  4.  Illustration  for  the  proof  chat  a  shortest  path  between  s  and  u 
passes  through  v. 
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We  now  analyze  che  running  doe  of  che  algorithm.  Case  (1)  of  the 
general  step  takes  constant  time;  Case  (2)  may  involve  scanning  a  large 
number  of  vertices;  however,  once  a  vertex  has  been  scanned  and  the 
corresponding  angle  has  been  found  to  require  continuation  of  the 
scanning  process,  that  vertex  is  definitively  eliminated  from  conslderadon. 
Since  in  P  there  are  n>2  vertices  besides  s  and  t,  the  entire  algorithm 
runs  in  time  0(n).  The  shor test-path  algorithm,  hcwever,  assuiaea  that  P 
be  a  sleeve.  To  transform  an  arbitrary  simple  n-vertex  polygon  into  a 
sleeve,  we  first  triangulate  it  in  time  O(nlogn)  using  the  algorithm 
of  [2];  the  dual  T  of  the  given  polygon  is  obtained  in  time  0(n)  and, 
still  in  linear  time,  the  path  tt  is  obtained.  This  completes  the 
transformation  of  the  polygon  into  che  required  sleeve.  Thus  che  endre 
procedure  runs  in  time  O(nlogn),  Che  criangulatlon  task  being  domlnanC. 
However,  if  preprocessing  is  allowed,  che  shortest  path  problem  can  be 
solved  in  0(n)  time  for  every  pair  of  points  s  and  t.  We  sumnarize  the 
results  as  a  theorem  below. 

Theorem  1.  Given  a  simple  polygon  P  with  n  vertices  and  two  points  s  and  c 
in  che  interior  of  P,  a  shortest  path  between  s  and  t  lying  entirely  within 
P  can  be  found  in  O(nlogn)  doe.  If  preprocessing  of  the  polygon  P  is 
allowed  with  preprocessing  doe  O(nlogn),  then  the  problem  can  be  solved 
in  0(n)  time  for  any  two  points  s  and  t  in  che  interior  of  P. 
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